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of abandonment as evidenced by the Notice of Abandonment dated 
October 6, 2005 (copy attached as Exhibit A) on the ground that 
Applicant never received an Office Action . 

The subject application is considered by the PTO to have 
been abandoned by Applicant's failure to respond to an Office 
Action mailed on July 28, 2004. At that time, I personally 
had not received the Office Action dated July 28 , 2004 in this 
Application, nor did I have any personal knowledge to the 
effect that any persons in my office received an Office 
Action. 

I personally performed a review of the corresponding 
docket record to determine if an Office Action was in fact 
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PETITION TO WITHDRAW HOLDING OF ABANDONMENT 
BASED ON FAILURE TO RECEIVE OFFICE ACTION 



Sir: 



Applicant (s) hereby petition to withdraw the holding 



received on or around July 28, 2004. I further reviewed the 
docket record to determine whether some response on this 
Application was due on a date that was some one, two, or three 
month multiple on or around July 28, 2004. This review showed 
no received communication was noted on the docket record. I 
further searched the contents of the docket file and again 
found no copy or reference to an Office Action on or around 
July 28, 2004. 

Thereafter, my assistant, Edna Chapa, conducted a 
telephone conference call with Examiner David D. Knepper to 
ascertain the nature, and to obtain a copy of, the July 28, 
2004 Office letter. During this call, Examiner Knepper 
explained the Office letter was in fact sent to us but 
returned undelivered. I explained that I had never received 
the Office letter and requested that he send me a facsimile 
copy for my records and so that I could properly prepare a 
response. (Copy attached as Exhibit B) . Upon receipt of the 
facsimile copy of the Office letter I promptly and diligently 
prepared an amendment in response to the Office Action dated 
July 28, 2004. 

The Applicants have made a diligent and sincere effort to 
clearly set out the facts and circumstances surrounding this 
matter and firmly believe that a sufficient showing is made 
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thereby for an immediate allowance of this Petition to this 
effect is earnestly solicited. 

Accordingly, it is requested that abandonment for this 
application be withdrawn, the Amendment be entered, and the 
status of the above- identified application be changed from 
abandoned to pending. 

If there are any difficulties regarding this matter, it 
is requested that the undersigned be contacted at the 
telephone number indicated below. 

Respectfully submitted, 

B y U/^y ^ ^\ 

Daniel J. Piotrowski, 
Reg. 42,079 

Attorney, (914) 333-9624 

Encl . : 

Exhibit A: Notice of Abandonment 
Exhibit B: . facsimile copy 

of Office Action dated July 28, 2004 

CERTIFICATE OF MAILING 

It is hereby certified that this correspondence is being deposited with 
the United States Postal Service as first-class mail in an envelope addressed to: 
COMMISSIONER FOR PATENTS 
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Application No. Applicant(s) 

09/311,333 ZIMMERMAN ETAL 

Examiner Art Unit 

David D. Knepper | 2654 

- The MAILING DATE of this communication appears on the cover sheet with the correspondence address— 

This application is abandoned in view of: 

1. S Applicant's failure to timely file a proper reply to the Office letter mailed on 28 July 2004 . 

(a) A reply was received on 22 February 2005 (with a Certificate of Mailing or Transmission dated 18 February 2005 ), which is 
after the expiration of the period for reply (including a total extension of time of 3'month(s)) which expired on 28 Jan 2005 : 

(b) □ A proposed reply was received on , but it does not constitute a proper reply under 37 CF.R 1 . 1 1 3 (a) to the final rejection. 

(A pro per reply under 37 CFR 1.113 to a final rejection consists only of: (1) a timely filed amendment which places the 
application in condition for allowance; (2) a timely filed Notice of Appeal (with appeal fee); or (3) a timely filed Request for 
Continued Examination (RCE) in compliance with 37 CFR 1.1 14). 

(c) □ A reply was received pn but it does not constitute a proper reply, or a bona fide attempt at a proper reply, to the non- 

final rejection. See 37 CFR 1.85(a) and 1.1 1 1. (See explanation in box 7 below). 

(d) □ No reply has been received. 

2. □ Applicant's failure to timely pay the required issue fee and publication fee, if applicable, within the statutory period of three months 

from the mailing date of the Notice of Allowance (PTOL-85). 

(a) □ The issue fee and publication fee, if applicable, was received on (with a Certificate of Mailing or Transmission dated 

), which is after the expiration of the statutory period for payment of the issue fee (and publication fee) set in the Notice of 

Allowance (PTOL-85). 

(b) □ The submitted fee of $ is insufficient. A balance of $ is due. 

The issue fee required by 37 CFR 1.18 is $ . The publication fee, if required by 37 CFR 1.18(d), is $ . 

(c) □ The issue fee and publication fee, if applicable, has not been received. 

3. D Applicant's failure to timely file corrected drawings as required by, and within the three-month period set in, the Notice of 

Allowability (PTO-37). 

(a) □ Proposed corrected drawings were received on (with a Certificate of Mailing or Transmission dated ), which is 

after the expiration of the period for reply. 

(b) □ No corrected drawings have been received. 

4. □ The letter of express abandonment which is signed by the attorney or agent of record, the assignee of the entire interest, or all of 

the applicants. 

5. □ The letter of express abandonment which is signed by an attorney or agent (acting in a representative capacity under 37 CFR 

1 .34(a)) upon the filing of a continuing application. 

6. □ The decision by the Board of Patent Appeals and Interference rendered on and because the period for seeking court review 

of the decision has expired and there are no allowed claims. 

7. □ The reason(s) below: 




David D. Knepper 
Primary Examiner 
Art Unit: 2654 



Petitions to revive under 37 CFR 1 .1 37(a) or (b), or requests to withdraw the holding of abandonment under 37 CFR 1 .1 81 , should be promptly filed to 
minimize any negative effects on patent term. __ 

U.S. Patent and Trademark Office 

PTOL-1432 (Rev. 04-01 ) Notice of Abandonment Part of Paper No. 8 
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United states Patent and Trademark office 
Washington, DC 2Q23I 
wwwuspiagov 




TELECOPY/FACSIMILE 
TRANSMISSION 
COVER SHEET 



DATE : 8 February 2005 

SERIAL #: 09/311,333 Ref #: 5494;57 



TO: ATTN: Edna Chapa 

(NAME) " 

NOTE : Action Mail date is 28 Jul 2004 

(COMPANY OR FIBM) 

(914) 332-0615 (914) 333-9610 _ 

(FAX NO.) (VOICBWHE NO.) 

FROM: David D. Knepper 

(NAME) 

(703^ 305-9644 

(VOICELINB NO-) 

NUMBER OF PAGES 12 (including this page) 

If you have not received all pages of this transmission, please contact the sender (sec FROM lines above). 

TECHNOLOGY CENTER 2600 
TELEFAX MACHINE: 703-872-9314 
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Office Action Summary 



Application No. 

00/311.333 



Examiner 
David D. Knepper 



Applicant^) 
ZIMMERMAN ETAL 



Art Unit 



2654 



is/are withdrawn from consideration. 



.. The MAILING DATE of this communication appears on the cover sheet with the correspondence address ~ 

Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

. Extensions of lime may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be umeiy HI W 

. Fellurelo reply witto, Iho sot or extendi period for reply will by statute, cause to application to become ABANOON ED (35US.a§ 133). 
Any reply received fry the Office later than IhreB months after the mailing dais of this commurncaUon, ©von if timely filed, may reduce any 
aarrwd patent term adjustment Sea 37 CFR 1.704(b). 

Status 

I )KI Responsive to communication(s) filed on 17 May 2004. 
2a)g| This action is FINAL. 2b)D This action is non-final. 

3p Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 
closed in accordance with the practice under Ex parte Quayte. 1935 CD, 11.453 O.G. 213. 

Disposition of Claims 

4) 0 Claim(s) M7 is/are pending in the application, 
4a) Of the above claim(s) , 

5) Q Claim(s) is/are allowed. 

6) IS Claim(s) M7 is/are rejected. 

7) Q Claim(s) is/are objected to. 

8) Q Clalm(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on 17 May 2004 is/are: a)E3 accepted or b)Q objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) Is objected to. See 37 CFR 1 .121(d). 

I I )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C,§ 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (1). 
a)Q All b)Q Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 
2.Q Certified copies of the priority documents have been received in Application No 



3-D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment^) 

1) □ Notice of References Cited (PTO-892) 4) □ Interview Summary (PT0413) 

2) □ Notice of DraftspensorVs Patent Drawing Review (PTO-948) Pa P er No(s)JMall Date. . 

3) D InfamtaDb^^ 5 > □ NoUceoflnformal Patent Application (PTCH52) 

Paper No(6VM3i) Date 6) U Other . 



U.S. Patent and Tradero* OHfce 
PTOU326 fRev. 1-GA) 



Office Action Summary 



Part of Paper NoJMail Dale 23 
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Paper #23 



1. Applicant's correspondence filed on 17 May 2004 (paper #22) has been received and 
considered. Claims 1-17 are pending. 



2. The amendment filed 15 October 2002 (paper #14) and 8 March 2002 (paper #6) is 
objected to under 35 U.S.C. 132 because they both introduce new matter into the disclosure. 35 
U.S.C 132 states that no amendment shall introduce new matter into the disclosure of the 
invention. The added material which is not supported by the original disclosure is as follows. 

Regarding paper #6, the second description of figure 2 added to page 7, line 13 
contradicts the first description and must be removed. 

Regarding paper #14, the claimed "selecting at least one adaptation algorithm from a 
plurality of adaptation algorithms ... to improve at least one application-specific feature" also 
contradicts the original description and must be removed. 

Applicant is required to cancel the new matter in the reply to this Office Action. 

3, The amendments to the specification were entered. 



4. The changes to figure 1 received 23 July 2002 (paper #8) would be approved if the label 
numbers currently missing from the specification can be a dded to the spe cification without 
adding new matter (i.e. - if the descriptions of these new elements in the drawing may be shown 
to have previously existed in the specification). 

The drawing changes inserting tables in the specification and re-numbering figure 5 as 



Drawings 



TUE 16:35 FAX 7033059508 

Application/Control Number: 09/311,333 
Art Unit: 2654 

figure 3 are approved. 

Claims 

5. The following is a quotation of the first paragraph of 35U.S.C 112: 

The specification shall contain a written description of the invention, and of the manner and process of making 
and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it 
pertains, or with which it is most nearly connected, to make and use the same and shall set forth the best mode 
contemplated by the inventor of carrying out his invention. 

6. Claims 1-17 are rejected under 35 ILS.C. 1 12, first paragraph, because the specification, 
while enabling for applying an adaptation algorithm, does not reasonably provide enablement for 
"selecting at least one adaptation algorithm from a plurality of adaptation algorithms .-.to 
improve at least one application-specific feature". The specification does not enable any person 
skilled in the art to which it pertains, or with which it is most nearly connected, to make and use 
the invention commensurate in scope with these claims. 

The specification teaches that the invention is able to utilize an adaptation algorithm. 

However, the specification fails to support selecting one type of adaptation algorithm 
from multiple adaptation algorithms. The specification has no implementation details to instruct 
one of ordinary skill in the art when or how such a selection process would be performed. The 
specification fails to provide details describing how to perform such a selection process based on 
a specific application. 

The language of claim 16 refers to memory "selecting code" and "updating code" and 
indicates that the code itself is applied and updated. The specification foils to teach how to make 
and use any type of code that can adapt itself. The claim indicates that "applying code to apply a 
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. Application/Control Number: 09/3 1 1 ,333 4 
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given adaptation algorithm" which is interpreted as meaning that the code is actually the 
algorithm is some unique code. The specification does not teach how to make any such unique 
code. 

In other words, the specification fails to support code which can not only update 
particular recognition data but can modify itself. This, if enabled, would allow an algorithm to 
modify itself and would actually change the algorithm to employ a different (modified) 
algorithm every time it is operated. 

To further prosecution, the claim is interpreted as a computer program that implements 
the method using a conventional computer prograinming language and "updating code" is 
interpreted as just updating data in the speech recognizer. 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art are such that the subject matter as a whole 
would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 

8. Claims 1-17 are rejected under 35 U.S.C. § 103 as being unpatentable over Sabourin 
(6,208,964) in view of Rowden ("Speech Processing"). 



02/08/05 TUE 16:36 FAX 7033059508 WORKGROUP 2740 @007 



. Application/Control Number: 09/31 1,333 Pa S e 5 

Art Unit; 2654 ^r#23 

As per claim 1, "improving the recognition accuracy of a speech recognizer" is taught or 
suggested by Sabourin' s adaptive speech recognition (abstract): 

"deploying the speech recognizer" (his speech recognition of figure 2); 
"collecting live input data" (his s peech source 100) : 

"without supervision, applying a given adaptation algorithm to the received live 
input data" (his adaptation module 112 which improvement is done to automate partially or fully 
the training of a speech recognition dictionary in a speech recognition system, col 1, lines 10- 
11); and 

"redeploying the adapted speech recognizer" (suggested in that he teaches that 
adapting the recognition system is for the purpose of improving it for later use - read abstract), 

It is noted that Sabourin does not explicitly teach the "redeploying". However, he 
teaches that the improvement made through updating the system can be used later. Thus, it 
would have been obvious for a person having ordinary skill in the speech recognition, at the time 
the invention was made, that the updating process of Sabourin could be used to improve any 
speech recognition for later use because this is Sabourin' s purpose for improving recognition. 

It is also noted the Sabourin does not explicitly teach "selecting at least one adaptation 
algorithm from a plurality of adaptation algorithms to improve at least one application- 
specific feature"- However, in describing prior ait systems and the application of modern 
techniques for adapting speech recognition, Rowdcn teaches that it is well known to select a 
suitable model and appropriate algorithms are used to compute the outp ut of the model for a 
specified input (for recognition or synthesis! on page 235. This is also considered in view of his 
teaching on page 229 that it was well known to raise the performance of recognition by adapting 
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the grammar depending upon the particular a pplication . On page 229 he also teaches that byfoe 

late sixties, simple tecrraquescould beused_toJrain vocabulary applications with as few as ten 

words. Rowden teaches that jt/<vould be ideal to train recognition for all of the possible 

sentences in a language, but mis is obviously completely impractical faaee 236). Rowden points 

out that other relationsh^steWeeniangu^elwSk be used to advantage such as the face 

that sentences may be broken into words, words into syllables, phonemes, etc. Given the variety 

of algorithms that are well known, Rowden concludes that it is obvious to choose the best 

t 

estimates for the least data— maximum generalization (page 236). Therefore, it would have been 
obvious to one of ordinary skill in the art to select simple adaptation techniques for applications 
requiring small vocabularies and to select more advanced adaptation techniques for applications 
requiring large vocabularies because of his figure 7.3 on page 228, figure 7.4 on page 230, figure 
7.5 on page 232, figure 7.6 on page 233 and the statistical techniques on pages 235-236 which 
show mat it was known to use different types teaming or updating for different applications of 
speech recognition. Rowden's application of this selection process is further illustrated using the 
speech partem modeling on pages 236-237 which teach the use of bi-gram syntax in hidden 
Markov models to maximize the training benefits. 

Claim 2: The prior art uses a computer 500, fig. 5. 

Claim 3: Data may be contained in storage 500 which is not directly recognizable by a 
human, fig. 5. 

Claim 4: Speech is not instantaneous and, therefore, must inherently be collected over 

time. 

Claim 5, 9: The use of acoustically significant phonemes is taught in column 5. 
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Claim 6: The use of Hidden Maikov Models is taught column 4. 

Claim 7: The use of a language model is taught by his use of a lexicon 302. 

Claim 8: Official Notice is taken that the use of bigram statistics is well known for use in 
context dependent HMM such as taught by Sabourin (see Rowdcn, page 237). 

Claim 10: Transcription is taught by Sabourin (see title). 

Claims 1 1-14 are rejected under similar arguments as applied above. 

Claim 16 is presumed to be an attempt to claim a computer program that performs the 
previously claimed method (claim 1, for example). 

Claim 17: Sabourin's unsupervised training inherently improves any pronunciation 
related measure to include dialect and speaking style. Channel characteristics would be 
inherently improved using any training technique consistently applied across the desired channel. 

9. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.1 36(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from Ihc mailing 
date of this final action. 
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REMARKS 



10. The abandonment of this application in March 2003 for failure to respond to the Final 
Rejection of May 2002 is regrettable since it appears that the applicant filed a response in 
October 2002. The Examiner has no explanation as to why this response was not entered or 
matched with the application until after the abandonment (over 10 months after Final Rejection). 

The Examiner has never confused the applicant's method invention as an apparatus and 
the comments to the contrary on page 12 of paper #22 are not appreciated. 

The Computer-Related Guidelines are familiar to the Examiner. The Examiner has never 
required or implied that the applicant must provide any computer code and the applicant's 
comments to the contrary on page 12 of paper #22 are not appreciated. 

The Examiner would consider a drawing of a diskette or a CD to be totally useless based 
on the claimed invention and the attached specification which both fail to indicate the invention 
of a new diskette or CD. Applicant's comments to the contrary on page 12 of paper #22 are not 
appreciated. 

The applicant's reference on page 13 of paper #22 to page 20 of the specification for 
support of claim 16 indicates that the Examiner has correctly interpreted this claim as software 
that performs the method of claim 1 (page 20, lines 16 to page 21, line 9). 

The argument on page 13 of paper #22 against the rejection under 35 USC 112, first 
paragraph is not convincing. Claim 1, for example, may be read upon prior art that only uses one 
adaptation algorithm ("at least one")- The prior art of Rowden has a clear explanation of the 
trade-offs that one of ordinary skill in the ait should apply to make a selection between known 
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adaptation algorithms (Rowden, page 236) but the applicant's disclosure is lacking any 
explanation for such a selection. It would be obvious to apply the prior art explanation to Ihe 
applicant's disclosure since they are discussing the same art of improving speech recognition 
using adaptation or training of the recognizer. This enables a rejection under 35 USC 103 but 
fails to overcome the applicant's obligation to fulfill the requirements of 35 USC 112, first 
paragraph. 

The applicant's argument against the use of Sabourin under 35 USC 103 is not 
convincing because Sabourin clearly selects the use of transcription adaptation for speech 
recognition. It is noted that Sabourin also teaches the use of the well known Hidden Markov 
Models (HMMsl for representing sub-word speech recognition models. This teaches that 
updating the speech models would also be obvious as part of the transcription adaptation that is 
being performed to improve speech recognition. 

11, Any response to this action should be mailed to: 

Box AF 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 

TC2600 Fax Center 
(703) 872-9315 



Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, Arlington. 
VA., Sixth Floor (Receptionist). 



02/08/05 TUE 16:37 FAX 7033059508 WORKGROUP 2740 ©012 



. Application/Control Number: 09/311,333 Pa 8 e 10 

ArtUnit:2654 Papef#23 

12. Any inquiry concerning this communication or earlier communications from the 

examiner should be directed to David D. Knepper whose telephone number is (703) 305-9644. 

The examiner can normally be reached on Monday-Thursday from 07:30 a.m.-6:00 p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil, can be reached on (703) 305-9645. 

Any inquiry of a general nature or relating to the status of this application should be 
directed to customer service at (703) 306-0377. 

The facsimile number for TC 2600 is (703) 872-9314. . . 

David D. Knepper 
Primary Examiner 
Art Unit 2654 



